(mathematics, stochastic processes) A square matrix whose rows consist of nonnegative real numbers, with each row summing to 1. Used to describe the transitions of a Markov chain; its element in the ith row and jth column describes the probability of moving from state i to state j in one time step.